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Abstract 

This report outlines the procedure and results of an experiment to characterize a 
bearing-only sensor for use with PHD filter. The resulting detection, measurement, 
and clutter models are used for hardware and simulated experiments with a team of 
mobile robots autonomously seeking an unknown number of objects of interest in an 
office environment. 


1 Introduction 

We are interested in applications such as environmental monitoring, search and rescue, 
precision agriculture, and landmark registration, in which teams of mobile robots can be 
used to explore an environment to search for objects of interest. In each of these scenarios, 
the number of objects is not known a priori, and can potentially be very large. Such 
situations are not a trivial extension of the single object case. In general, the sensor can 
experience false negatives {i.e., missing objects that are actually there), false positives {i.e., 
seeing objects that are not actually there), and even when a true detection is made it 
is potentially a very noisy estimate. Another challenge faced in multi-target tracking is 
the task of data association, or matching measurements to objects. The number of such 
associations grows combinatorially with the number of objects and measurements, and it is 
often not possible to uniquely identify individual objects. 

We track the distribution of multiple objects using the Probability Hypothesis Density 
(PHD) filter. The PHD models the density of objects in the environment [4] and the PHD 
filter, from Mahler [3], simultaneously estimates the number of objects and their locations 
in a computationally tractable manner. We use the sensor models from this report in 
hardware and simulated experiments where a team of mobile robots autonomously detects 
and localizes an unknown number of objects using an information-based, receding horizon 
control law [2]. See Dames and Kumar [2] for further motivation of the problem area and 
detail on the problem formulation and the estimation and control algorithms. 

Each robot is equipped with a sensor that is able to detect objects within its field of 
view. The probability of a sensor with pose q detecting a target at x is given by pd{x;q) 
and is identically zero outside of the field of view. Note the dependence on the sensor’s 
position, denoted by the argument q. If a target at x is detected by a robot at q then it 
returns a measurement z ~ g{z \ x; q). The false positive, or clutter, model consists of a 
PHD c{z; q) describing the likelihood of clutter measurements in measurement space and the 
expected clutter cardinality. Note that in general the clutter may depend on environmental 
factors. The remainder of this report details the experimental system, descriptions of the 
three sensor models, and the resulting best-fit models to the collected data. 

*This work will also appear in [1]. 

tphilip Dames and Vijay Kumar are with the Department of Mechanical Engineering and Applied Me¬ 
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Figure 1: A Scarab robot with two objects in the experimental environment. 


2 Experimental System 

We conduct experiments using a small team of ground robots (Scarabs), pictured in Fig. 1. 
The Scarabs are differential drive robots with an onboard computer with an Intel i5 processor 
and 4GB of RAM, running Ubuntu 12.04. They are equipped with a Hokuyo UTM-30LX 
laser scanner, used for self-localization and for target detection. The robots communicate 
with a central computer, a laptop with an Intel i7 processor and 16GB of RAM running 
ROS on Ubuntu 12.04, via an 802.1 In network. The team explores in an indoor hallway, 
shown in Fig. 2, seeking the reflective objects pictured with the robot in Fig. 1. 

We use a simple sensor, by converting the Hokuyo into a bearing-only sensor. This may 
be thought of as a proxy to a camera, but it avoids common problems with visual sensors 
such as variable lighting conditions and distortions. The objects are 1.625 in outer diameter 
PVG pipes with attached 3M 7610 reflective tape. The tape provides high intensity returns 
to the laser scanner, allowing us to pick out objects from the background environment. 
However, there is no way to uniquely identify individual objects, making this the ideal 
setting to use the PHD filter. 

The hallway features a variety of building materials such as drywall, wooden doors, 
painted metal (door frames), glass (office windows), and bare metal (chair legs, access 
panels, and drywall corner protectors, like that in the right side of Fig. 1). The reflective 
properties of the environment vary according to the material and the angle of incidence of 
the laser. The intensity of bare metal and glass surfaces at low angles of incidence is similar 
to that of the reflective tape. Fig. 4 shows an example laser scan from the environment, 
with the robot at (0,0) and oriented along the x-axis. The objects show up as clear, high 
intensity sections in the laser scan, though the intensity decreases with distance to the robot 
(objects 1-5 are placed 1-5m from the robot, respectively). 

Motivated by this, we select a threshold on the laser intensity of 11000 (shown as a black 
dotted line in the plots) to be able to reliably detect objects within a 5 m range of the robot. 
At low angles of incidence, bare metal and glass have laser returns of similarly intensity to 
the true objects, creating clutter measurements. Note that glass has an extremely narrow 
band of angles of incidence (« 0.02°) that create high intensity returns, while the metal 
has a slightly wider range (« 2.5°). If we were to eliminate the clutter detections, then the 
effective sensing range of the robots would only be less than 2 m, significantly decreasing 
the utility of the system. 


2 








5 10 15 20 25 

X[m] 


Figure 2: A floorplan of the Levine environment used in the hardware experiments. Different 
starting locations for the robots are labeled in the map. 


To turn a laser scan into a set of bearing measurements, we first prune the points based 
on the laser intensity threshold, retaining only those with sufficiently high intensity returns. 
The points are clustered spatially using the range and bearing information, with each cluster 
having a maximum diameter dt- The range data is otherwise discarded. The bearings to 
each of the resulting clusters form a measurement set Z. 

A team of three robots drove around the environment for 20 min collecting measurements 
of 15 targets at known positions. To move around the environment, the robots generated 
actions over length scales ranging from Im to 20 m, as shown in Fig. 3, and randomly 
selected actions from the candidate set. This allowed the robots to cover the environment 
much more effectively than a pure random walk. The collected data set consists of 1959 
measurement sets {i.e., laser scans) containing 2630 individual bearing measurements. 


.. 


O 


O. 




O.O 


.a-" 


Q 


0 




,-a" 




o 

6 


o 


o-.. 


..-o. 


.o 




.o 


Figure 3: Example action set with a horizon of T = 3 steps and three length scales. Each 
action is a sequence of T poses at which the robot will take a measurement, denoted by the 
hollow circles. 
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(a) XY laser scan 


(b) Intensity plot and measurement set 
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Figure 4: An example laser scan from the Levine environment, (a) Shows the XY scan labeled according to the building material. Objects 1-5 are 
placed 1-5 m from the robot and the sources of clutter measurements are also labeled, (b) Shows the corresponding intensity plot with material labels 
and the resulting measurement set. (c)-(e) Show insets of specific objects of interest within the scan and the resulting measurements. 
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(a) Detection model (b) Clutter model 

Figure 5: (a) A pictogram of the laser detection model, where dt is the diameter of the target, 
Osep is the angular separation between beams, and r is the range, (b) Best fit detection model 
to 1588 true detections, from 1959 measurement sets, and 1007 false negative detections. 

3 Experimental Sensor Models 

We now develop the detection, measurement, and clutter models necessary to utilize the 
PHD filter using the robot, sensor, and targets from the previous section. 

3.1 Detection Model 

The detection model can be determined using simple geometric reasoning due to the nature 
of the laser scanner, as Fig. 5a shows. Each beam in a laser scan intersects a target that 
is within dt/2 of the beam. The arc length between two beams at a range r is rOsep, and 
the covered space is dt- Using the small angle approximation for tangent, the probability of 
detection is 


Pd{x-,q) = (l-pfn)min [l, , —) l{b{x,q) € [&min, &max])l(c(a;, g) G [0,rmax]) (1) 

where r(a;, q) and b{x, q) are the range and bearing of the target in the local sensor frame, 
Pfn is the probability of a false negative, and l( •) is an indicator function. The bearing is 
limited to fall within [6niin) ^max] and the range to be less than some maximum value 
(here due to the intensity threshold on the laser and the reflectivity of the targets). 

To find the optimal parameter values, we take the collected data and determine which 
measurements originate from true objects. A measurement is labeled as a true detection if 
it is within Scr of the true bearing to the target and within the held of view of the robot, 
given its current pose. Since the PHD hlter assumes that each target creates at most one 
measurement per scan, once a measurement-to-target association is made, that target is no 
longer ht to any other measurements in a measurement set. If no measurement is associated 
to a target, the target is labeled as a false negative detection. The collected data contains 
1588 true detections and there are 1007 false negative detections. 

We bin this labeled data as a function of the true range to the target in 0.2 m increments, 
computing the probability of detecting a target within each range bin. We search over pfn 
(from 0 to 1 in steps of 0.005) and dt (from Oin to 2 in in steps of 0.01 in), computing the 
sum-of-squares error between the data and the parameterized model. We hnd the effective 
target diameter dt since the intensity is below the cutoff threshold at extremely high angles 
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Figure 6: Detection model sum of squares error (SSE) (blue circles) and the fraction of mea¬ 
surements that were classified as detections (orange exes) as a function of the measurement 
noise parameter. 


of incidence to the reflective tape (see Fig. 4c). Fig. 5b shows the best fit model, with 
Pfn = 0.210 and dt = 1.28 in. These parameters are reasonable, with the effective target 
diameter being 78.8% of the true target diameter. This corresponds to a maximum angle 
of incidence of 52.0°, which is orders of magnitude larger than the for glass or metal. 


3.2 Measurement Model 


The sensor returns a bearing measurement to each detected target. We assume that bear¬ 
ing measurements are corrupted by zero-mean Gaussian noise with covariance a, which is 
independent of the robot pose and the range and bearing to the target. In other words. 


9{z I x\q) 
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exp 


{z-b{x,q)y 

2a2 ^ 


( 2 ) 


where b(x, q) is the bearing of the target in the sensor frame. 

During the runs, the robots occasionally experience significant errors in localization due 
to occlusions by transient objects, long feature-poor hallways, and displaced semi-static 
objects, e.g., chairs. Since no ground-truth localization data is available in the experimental 
environment, we fit the noise parameter cr by searching over a range of possible values. Note 
that the value of a affects the target-to-measurement association, and thus the detection 
and clutter model parameters. 

Fig. 6 shows that the choice of a parameter creates a frontier for the detection model 
SSE and the fraction of measurements classified as detections. With very low values of tr, 
there are few inliers, i.e., labeled detections, so the model fits well but is not meaningful. 
The error in the fit increases until around a = 1.25°, when it begins to decrease. From this 
point, the model fits increasingly well, though after a point the decrease is due to overfitting 
the data and there is a clear “knee” in the data. This is also the point where the fraction 
of inliers levels out. We select a = 2.25° as the best fit measurement noise parameter, and 
use this to fit the detection and clutter models. 


3.3 Clutter Model 

As previously noted, clutter {i.e., false positive) measurements arise due to reflective surfaces 
within the environment, such as glass and bare metal, only at low angles of incidence. Since 


6 








0.45 



CD 


0.4 

0.35 

§ 0.3 
o 

o 0.25 

>s 

I 0.2 

CD 

o 0.15 
qI 

0.1 

0.05 

0 


Data 

Fit 


-1 0 1 
Bearing [rad] 


(a) Clutter model 


(b) Clutter distribution 


Figure 7: (a) A pictogram of the clutter model, where 9c is the width of the clutter peaks 
centered at ±|, and the bearing falls within the range (b) Best ht clutter 

probability density function, using 1010 clutter measurements from 1959 measurement sets. 


these materials are mostly found on walls, which are to the side of the robot when it is 
driving down a hallway, there will be a higher rate of clutter detections near rad in the 
laser scan. For objects such as table and chair legs there is no clear relationship between 
the relative pose of the object and robot, so we assume that such detections occur uniformly 
across the field of view of the sensor. This leads to a clutter model of the form shown in 
Fig. 7a. 

Let 9c be the width of the clutter peaks centered at and let be the probability 
that a clutter measurements was generated from a target in the uniform component of the 
clutter model. The clutter model is 

l(&e [Vin,Vax]) + (^-^)^ l(||b|-^/2| < 0,/2), (3) 

^max ^min ■^t'c 

where /r is the expected number of clutter measurements per scan. The clutter cardinality, 
TO, is assumed to follow a Poisson distribution with mean /i [3]. 

All measurements that are not associated to a target, as described in Sec. 3.1, are 
considered to be clutter measurements. We bin the bearings of these clutter measurements 
in ^ increments to create a piecewise-constant distribution. We perform a search over 9c 
(from Orad to | rad in steps of ^ rad) and (from 0 to 1 in steps of 0.005) to find the 
best ht parameters (using the sum-of-squares error) to the data, with Fig. 7b showing the 
best ht model, with 9c = 0.2007rrad and = 0.725. The number of clutter measurements 
per scan is used to ht the clutter cardinality parameter /x, with Fig. 8 showing the best ht 
value, n = 0.5319. 

3.4 Analysis 

All of these sensor parameters depend upon the specihc robot, sensor, targets, and envi¬ 
ronment. For example, the peaks in the clutter model near arise due to the geometry 
and appearance of the environment. In a more open setting, or with a more limited held of 
view sensor, we would not expect to see these peaks in the clutter distribution. Or in an 
environment with more glass walls we would expect the number of clutter detections to be 
higher and the peaks to be more pronounced. 

The detection statistics also depend highly upon our particular experimental setup. The 
strip of rehective tape is only 1 in tall and the sensor is planar, so a bump in the hoor of only 
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Figure 8: Best fit model for the clutter cardinality, using 1010 clutter measurements from 
1959 measurement sets. 

2.5 mm will cause the robot to pitch sufhciently to fail to detect a target that is 1 m away. 
Any small bumps in the linoleum flooring, particularly at transitions to carpeting, cause 
the robot to experience false negative detections. Additional false negatives may occur due 
to occlusions from transient objects, e.g., passing people and other robots, and semi-static 
objects such as chairs. 

4 Conclusion 

In this report we outline an experimental setup and procedure to characterize the detection, 
measurement, and clutter statistics of a bearing-only sensor in an indoor ofhce environment. 
While the specific values found in this work are particular to the experimental setup, we 
believe that by using the same parametric sensor models and by following the same exper¬ 
imental methodology we would be able to operate in different environments. Getting the 
correct sensor statistics is particularly important when using the PHD filter, as over- or 
under-conhdence in any of the models causes a bias in the estimate of the target cardinality. 
The resulting sensor models will be used to run the PHD filter on a team of mobile robots 
in order to autonomously detect and localize an unknown number of objects. 
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